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Box No. I Basis of the report 

1 . With regard to the language, this report is based on the international application in the language in which it was 
filed, unless otherwise indicated under this item. 

□ This report is based on translations from the original language into the following language , 
which is the language of a translation furnished for the purposes of: 

□ international search (under Rules 12.3 and 23.1(b)) 

□ publication of the international application (under Rule 12.4) 

□ international preliminary examination (under Rules 55.2 and/br 55.3) 

2. With regard to the elements* of the international application, this report is based on (replacement sheets which 
have been furnished to the receiving Office in response to an invitation under Article 14 are referred to in this 
report as "originally filed" and are not annexed to this report): 



Description, Pages 

1-28 as originally filed 

Claims, Numbers 

1 -36 filed with telefax on 1 3.06.2005 

Drawings, Sheets 

1/16-1 6/t 6 as originally filed 

□ a sequence listing and/br any related table(s) - see Supplemental Box Relating to Sequence Listing 
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□ the description, pages 

□ the claims, Nos. 

□ the drawings, sheets/f igs 

□ the sequence listing (specify): 

□ any table(s) related to sequence listing (specify): 

4. □ This report has been established as if (some of) the amendments annexed to this report and listed below 
had not been made, since they have been considered to go beyond the disclosure as filed, as indicated in the 
Supplemental Box (Rule 70.2(c)). 

□ the description, pages 

□ the claimsrNosr — 

□ the drawings, sheets/ligs 

□ the sequence listing (specify): 

□ any table(s) related to sequence listing (specify): 
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1 . Reference is made to the following documents: 

D1: RUMMEL P: "A MODEL-BASED VISUAL SENSOR SYSTEM FOR COMPLEX 
INDUSTRIAL SCENES" SIEMENS FORSCHUNGS- UND 
ENTWICKLUNGSBERICHTE, SPRINGER VERLAG. BERLIN, DE, vol. 13, no. 3, 
1984, pages 151-154, XP002010726 ISSN: 0370-9736 

D2: JUVIN D ET AL: "ANIMA (ANALYSES OF IMAGES) A QUASI REAL TIME SYSTEM" 
PROCEEDINGS - IEEE COMPUTER SOCIETY CONFERENCE ON PATTERN 
RECOGNITION AND IMAGE PROCESSING 1982. 1982 IEEE, NEW YORK, NY, 
USA, 1982, pages 358-361, XP0023052 19 

D3: HORNG J-H: "An adaptive smoothing approach for fitting digital planar curves with 
line segments and circular arcs" PATTERN RECOGNITION LETTERS, NORTH- 
HOLLAND PUBL. AMSTERDAM, NL, vol. 24, no. 1-3, January 2003 (2003-01), 
pages 565-577, XP004391 198 ISSN: 0167-8655 

D4: MINSKY D E ET AL: "Optimal boundary detection on grey-tone image" PATTERN 
RECOGNITION, PERGAMON PRESS INC. ELMSFORD, N.Y, US, vol. 30, no. 6, 1 
June 1997 (1997-06-01), pages 971-998, XP004064090 ISSN: 0031-3203 

D5: US-A-5 351 31 0 (CALIFANO ANDREA ET AL) 27 September 1 994 (1 994-09-27) 

D6: HECKER Y C ET AL: "ON GEOMETRIC HASHING AND THE GENERALIZED 
HOUGH TRANSFORM" IEEE TRANSACTIONS ON SYSTEMS, MAN AND 
CYBERNETICS, IEEE INC. NEW YORK, US, vol. 24, no. 9, 1 September 1994 
(1994-09-01), pages 1328-1338, XP000462405 ISSN: 0018-9472 

D7: US-A-5 828 769 (BURNS J BRIAN) 27 October 1998 (1998-10-27) 

Re Hem V 

Reasoned statement with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement, Article 33(1 ),(2) and (3) PCT. 

2. The subject-matter of claim 1 is new and involves an inventive step, for the following 
reasons: 

2.1 Amongst the cited documents, D5 is considered to be the closest prior art. 

D5 discloses a method and system for recognition of three dimensional objects from 
a two dimensional image of the object (col. 1 , lines 9-14), comprising the steps of 
identifying features, being sets of primitives, for the image (local shape descriptors, 
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col. 9, lines 14-23); 

extracting numerical descriptors of the features of extrinsic and intrinsic properties of 
the features (col. 9, line 32- col. 10, line 2). 

matching said properties with those stored in a database for known objects (figure 5, 
7). 

2.2 D5 does not disclose applying a homographic transformation to the features. 

2.3 The objective technical problem solved by this feature is to enable matching of 
images subject to strong perspective. 

2.4 Neither this problem, nor the solution is known from any of the cited documents. 
Hence the subject-matter of claim 1 cannot be deemed to follow in a straightforward 
manner from the prior art. 

3. The subject-matter of claim 20 concerns a method for generating a database as used 
in the method of claim 1 , including the step of extracting intrinsic properties of 
features after applying a homographic transformation to the features. 

3.1 Therefore also the subject-matter of claim 20 is to be considered as involving an 
inventive step, for the same reasons as formulated in above items 2.2-2.4. 



4. Dependent claims 2-19 and 21-36 have a further limiting effect and therefore also 
comprise new and inventive subject-matter. 



Re Item VIII 

Certain observations on the international application — 

5. It is noted that the definition of the particular homographic transformation that is 

applied appears to be an essential feature of the invention. Hence the present claims 
are not deemed to meet the requirement of support by the description, Article 6 PCT. 
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AMENDED CLAIMS, 10 June 2005; response to Written r Opinion ~ 

J. A method for recognition, such as classification and/or localisation of three dimensional 
objects, said one or mors objects being Imaged so as to provide a recognition Image being 
5 a two dimensional digital image of the object, said method utilises a database In which 
numerical descriptors are stored for a number of training Images, the numerical 
descriptors are the intrinsic and extrinsic properties of a feature, said method comprising: 
Identifying features, being predefined sets of primitives, for the image 
extracting numerical descriptors of the features, said numerical descriptors being of 
the two kind: 

extrinsic properties of the feature, such as the location and orientation of 
the feature In the Image, and 

intrinsic properties of the feature derived after a nomographic 
transformation being applied to the feature 
matching said properties with those stored In the database and In case a match is 
found assign the object corresponding to the properties matched In the database to 
be similar to the object of the object to be recognised. 



2. A method according to dalm 1, for matching a recognition image with training Images 
20 stored In a database, wherein the matching comprising the following steps: 
for each training Image: 

determining the values of roll, tilt and pan of the transformations bringing the 
features of the recognition Image to be Identical with the features of the training 
Image; 

identify dusters in the parameter space defined by the values of roll, tilt and pan 
determined by said transformations 

and 



15 - 



25 



30 



Identify dusters having predefined intensity as corresponding to an object type and 
localisation. 

3. A method according to dalm 1 or 2, wherein the database comprise for each Image one 
or more records each representing a feature with Its Intrinsic properties and its extrinsic 
properties. 



35 4. A method according to claim 3, wherein the matching comprises the steps of: 
resetting the roll, tilt and pan parameter space, 

_ _ f ° r e9Ch feature in the rec °9 ni «on image, matching properties of the recognition 
TSiige wffifT tKeproperfes'sto " 
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In case of match: determining roll, tllf, andWn bd5Vd on me extrinsic properties 
from the database and from the recognition Image, 
updating the parameter space, and 

test for dusterlng and store coordinates of dusters with sufficiently high 
5 density/population with an Index of the training image, 

repeating the steps until all features in the recognition image have been matched. 

5. A method according to claim 4 wherein the determination of the roll, tilt and pan are 
only done for features having similar or identical intrinsic properties compared to the 

10 intrinsic properties in the database. 

6. A method according to daim 4 wherein the matching comprises comparing the intrinsic 
descriptors of the recognition image with the Intrinsic descriptors stored In the database 
thereby selecting matching features. 

15 

7. A method according to claim l to 6, wherein the generation of said database comprises 
determination of contours, preferably level contours, and primitives in a digital image, said 
determination comprising the steps of: 

generating the gradients of the digital Image; 
20 - finding one or more local maxima of the absolute gradients; 

use the one or more local maxima as seeds for generating contours, the generation 

of the contours for each seed comprising determining an ordered list of points 

representing positions in the digital image and belonging to a contour; 

for alt of said positions determining the curvature, preferably determined as d9/ds 
25 preferably pixel units, of the contours; 

from the determined curvatures determine primitives as characteristic points on or 

segments of the contours. 

8. A method according to claim 7 rurther comprising the step of eliminating potential seed 
30 points Identified near already defined contours. 

9. A method according to any of the claims 7-8, wherein the generation of the contours 
comprising assigning the list of points representing positions In the digital Image, each 
point having a value being assigned to be common with the value of the seed. 

35 

10. A method according to any of the daims 7-8, wherein the generation of the contours 
comprising assigning the list of points following in each point the direction of the maximum 

bTmfr?i^ - 
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11. A method according to dairn 7-8, wherefrrthe generation of the contours comprising 
assigning the list of points with values being above or below the value of the seed and one 
or more neighbour pixels with value below or above said value of the seed. 

5 12. A method according to claim 7-11, wherein the list of pixels Is established by moving 
through the digital image in a predetermined manner. 

13. A method according to claim 8-12, wherein the contours being determined from an 
Interpolation based on the list of pixels. 

10 

14. A method according to daim 8-13 wherein the list is an ordered list of pixels. 

15. A method according to claim 7-14, wherein the gradients are determined by calculating 
the difference between numerical values assigned to neighbouring pixels. 

16. A method according to daim 7-15, wherein the gradients are stored m an array in 
which each element corresponds to a specific position in the first image and being a 
numerical value representing the value of the gradient of the first Image's tones in the 
specific position. 

17. A method according to daim 7-16, wherein the curvatures being established as 
x^dS/ds where 0 is the tangent direction at a point on a contour and s Is the arc length 
measured from a reference point. 

2S IB. A method according to any of the dalms 7-17, wherein the primitives comprise of one 
or more of the following characteristics: 
segments of straight lines, 
segments of relatively large radius clrdes, 
inflection points, 

30 «• points of maximum numerical value of the curvature, said points being preferably 
assigned to be corners, 

points separating port/ons of very low and very high numerical value of the 
curvature, and 

small area entitles enclosed by a contour, 

35 

19. A method according to any of tne daims 7-18, wherein each contour Is searched for 
one or more of the following primitives: 

; wn ^°"P°W6&W^ 

absolute val ue of the curvature being higher tftan a nrprfpfinpp; i^ ); 
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concave corner, being a-region-of-or a point on the contour having positive peaks of 
curvature; 

convex corner, being a region of or a point on the contour having negative peaks of 
curvature; 

5 - straight segment, being segments or the contour having zero curvature; 
and/or 

circular segments, being segments of the contour having constant curvature. 

20. A method of generating a database useful in connection with localising and/or 
10 classifying a three dimensional object, said object being imaged so as to provide a two 
dimensional digital image of the object, 

wherein the determination of primitives in the two dimensional digital image of the object 
comprises the steps of 

generating the gradients of the digital Jmage; 
15 - finding one or more focal maxima or the absolute gradients; 

use the one or more local maxima as seeds for generating contours, the generation 
of the contours for each seed comprising determining an ordered list of points 
representing positions in the digital (mage and belonging to a contour; 
for alt of said positions determining the curvature, preferably determined as dB/ds 
20 preferably pixel units, of the contours; 

from the determined curvatures determine primitives as characteristic points on or 
segments or the contours. 
saJd method further comprising: 

Identifying features, being predefined sets of primitives, in a number of digital 
25 images of one or more object, the images represent different localisations of the 

one or more object; 

extracting and storing in the database, numerical descriptors of the features, said 
numerical descriptors being of the two kind: 

extrinsic properties of the feature, that is the location and orientation of the feature 
30 in the image, and 

intrinsic properties of the feature being derived after a nomographic transformation 
being applied to the feature. 

21. A method according to dalm 20 further comprising the step of eliminating potential 
35 seed points identified near already defined contours. 

22. A method according to any of the daims 20-21, wherein the generation of the contours 
point having a value being _ asslgned to b e common with rh P vah,* nf iHp cooH 
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23. A method according to any of the daims 20-21, wherein the generation of the contours 
comprising assigning the list of points following In each point the direction of the maximum 
or minimal gradient detected perpendicuJar to a contour direction. 

5 

24. A method according to claim 20-21, wherein the generation of the contours comprising 
assigning the list of points with values being above or below the value of the seed and one 
or more neighbour pixels with value below or above said value of the seed. 

10 25. A method according to daim 20-24, wherein the list of pixels Is established by moving 
through the digital Image in a predetermined manner. 

26. A method according to daim 21-25, wherein the contours being determined from an 
interpolation based on the list of pixels. 

15 

27- A method according to claim 21-26 wherein the list is an ordered fist of pixels. 

28. A method according to claim 20^27, wherein the gradients are determined by 
calculating the difference between numerical values assigned to neighbouring pixels. 

20 

29. A method according to daim 20-28, wherein the gradients are stored in an array in 
which each element corresponds to a speofic position in the first Image and being a 
numerical value representing the value of the gradient of the first Image's tones In the 
spedfic position. 

25 

30. A method according to daim 20-29, wherein the curvatures being established as 
x=de/ds where 6 Is the tangent direction at a point on a contour and s is the arc length 
measured from a reference point. 

30 31. A method according to any of the dalms 20-30, wherein the primitives comprise of one 
or more of the following characteristics: 
segments of straight lines, 
segments of relatively large radius circles, 
inflection points, 

35 - points of maximum numerical value of the curvature, said points being preferably 
assigned to be corners, 

points separating portions of very low and very high numerical value of the 

~" cu7yature f *'aTid ~*~ ** - — 

sm all area entitles enclosed bv a contour. 
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32. A method according to any of the claims 20-31, wherein each contour Is searched for 
one or more of the following primitives: 

Inflection point, being a region of or a point on the contour having values of the 
5 absolute value of the curvature being higher than a predefined level; 

concave comer, being a region of or a point on the contour having positive peaks of 
curvature; 

convex comer, being a region of or a point on the contour having negative peaks of 
curvature; ... 

10 - straight segment, being segments of the contour having zero curvature; 
and/or 

circular segments, being segments of the contour having constant curvature. 

33. A method according to any of the claims 1-32, wherein the extrinsic properties 
IS comprises a reference point and a reference direction. 

34. A method according to any of the claims 1-33, wherein the Intrinsic properties 
comprises numerical quantities of features. 

20 35. A method according to any of the claims 1-19 wherein the object being Imaged by at 
least two Imaging devices thereby generating at least two recognition Images of the object 
and wherein the method according to any of the claims 1-34 are applied to each 
recognition image and wherein the match found for each recognition Image are compared. 

25 36. A method according to claim 35, where the method comprising the steps of; 

for each Imaging device, providing an estimate for the three dimensional reference 
point of the object, 

for each Imaging device, calculating a line from the Imaging device pinhole to the 

estimated reference point, 
30 and when at least two or more lines have been provided, 

discarding the estimates in the case that the said two or more lines do not 

essenUally intersect in three dimensions, 
and when the said two or more lines essentially intersect, 

estimating a global position of the reference point based on the pseudo Intersection 
35 between the lines obtained from each Imaging device. 
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